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user interface data set operatively coupled to the dialog manager, the user interface data set 
representing spoken language interface elements and data recognizable by the application of the 
device; wherein: (i) the dialog manager enables connection between the input audio system and the 
speech recognition engine such that the spoken utterance provided by the user is provided from the 
input audio system to the speech recognition engine; (ii) the output generated by the speech 
recognition engine is returned to the dialog manager; (iii) the dialog manager uses the output 
generated by the speech recognition engine to search the user interface data set for a corresponding 
spoken language interface element and data which is returned to the dialog manager when found; 
(iv) the dialog manager provides the spoken language interface element associated data to the 
application of the device for processing in accordance therewith; (v) the application of the device, 
on processing that element, provides a reference to an interface element to be spoken; (vi) the dialog 
manager enables connection between the audio output system and ;he speech synthesizing engine 
such that the speech synthesizing engine which, accepting data from that element, generates a 
synthesized output that expresses that element; and (vii) the audio output system audibly presenting 
th e synthesized output to the user; a method for modifying a data structure containing the at least one 
user interface data set, comprising: 

adding a new application to the device; 

generating a second user interface data set in accordance with the new application, 
the second user interface data set representing spoken language interface elements: and data 
recognizable by the new application; 

transferring the second user interface data set from the device to the apparatus; and 
loading the second user interface data set into the data structure of the apparatus. 



18. (Amended) The apparatus of claim 16, wherein the portable spoken language interface 

device comprises a personal speech assistant (PSA), the PSA comprising: 

an audio input system for receiving speech data provided by the user; 

an audio output system for outputting speech data to the user; 

a speech recognition engine for generating an output in response to spoken utterances; 
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a speech synthesizing engine for generating a synthesized speech output in response 

to text data; 

a dialog manager operati vely coupled to the device, the audio input system, the audio 
output system, the speech recognition engine and the speech synthesizing engine; and 

at least one user interface data set operati vely coupled to the dialog manager, the user 
interface data set representing spoken language interface elements and data recognizable by the 
application of the device; 

wherein: 

the dialog manager enables connection between the input audio system and 
the speech recognition engine such that the spoken utterance provided by the user is provided 
from the input audio system to the speech recognition engine; 

the output general ad by the speech recognition engine is returned to the dialog 

manager; 

the dialog manager uses the output generated by the speech recognition engine 
to search the user interface data set for a corresponding spoken language interface element 
and data which is returned to the dialog manager when found; 

the dialog manager provides the spoken language interface element associated 
data to the application of the device for processing in accordance therewith; 

the application of the device, on processing that element, provides a reference 
to an interface element to be spoken; 

the dialog manager enables connection between the audio output system and 
the speech synthesizing engine such that the speech synthesizing engine which, accepting 
data from that element, generates a synthesized output that expresses that element; and 

the audio output system audibly presents the synthesized output to the user. 




